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© A proposition truth value storing means (100) 
stores a truth value u,A of a first proposition part (A) 
and a truth value uB of a second proposition part 
(B). A rule truth value learning means 125 learns a 
rule truth value with uA and uB. (A) rule validity 
learning means (150) learns a rule validity degree fr. 
A rule truth value storing means (120) stores the rule 
truth value. A rule validity degree storing means 
(130) stores the rule validity degree fr. A bounded 
difference calculating means (160) calculates an in- 



ference validity degree (fi). A quantizer (165) deter- 
mines whether or not (fi) is equal to or larger than a 
predetermined threshold value. An inference result 
storing means (170) outputs a rule truth value uR as 
a truth value of the other of the propositions (A) and 
(B). A minimum value calculating circuit (180) se- 
lects the rule validity degree fr or the inference 
validity degree fi, whichever smaller. A result validity 
storing means (190) outputs (fr) or (fi), whichever 
smaller, as an inference result validity degree. 
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Background of the Invention: 

The present invention relates to an information 
processing system dealing with knowledge infor- 
mation and fuzzy inference, in particular, to a fuzzy 
inference system for learning the relation of cause 
and effect with respect to knowledge information. 

The fuzzy inference is an inference technique 
based on a language approximation or a fuzzy 
logic. The fuzzy inference is introduced by L. A. 
Zadeh by using the concept of fuzzy set so as to 
infer information including ambiguity and uncer- 
tainty. For example, when "a" is small (A1) and "a" 
is almost equal to "b" (A2), it can be inferred that 
"b" is relatively small (B). Thus, in the fuzzy infer- 
ence, an inference rule of if-then type (where if 
both propositions A1 and A2 are true, then (B) is 
true) is used. 

The fuzzy inference which has been widely 
used in home appliances and control machinery is 
a composition of the inference rule of if-then type 
and a membership function. With a collated result 
of a membership function of a first proposition part 
of an inference rule of if-then type, an optimum 
value of a second proposition part is interpolated 
by a defuzzing means such as a weighing method. 

Practical techniques for the inference system 
are described in Japanese Patent Laid-Open Pub- 
lications Nos. Hei 03-154129, 01-119803, 01- 
103704 to 01-103707, 63-265309, 61-264411, and 
so forth. Although the techniques for the inference 
system have been improved, the basic concept of 
the inference has not been changed. 

With reference to Fig. 13, a conventional fuzzy 
inference technique will be described in more de- 
tail. Now assume that there are two inference rules. 
The first inference rule is in that if A1(x) is satisfied, 
B1(y) takes place. The second inference rule is in 
that if A2(x) is satisfied, B2(y) takes place. A mem- 
bership function 710 which collates the first propo- 
sition parts of the inference rules represents A1(x) 
and A2(x). A membership function 720 which col- 
lates the second proposition parts of the inference 
rules represents B1(y) and B2(y). When an input 
variable x is xO, the membership function 710 gives 
A1(x0) and A2(x0). Thus, the membership function 
710 gives a minimum calculation result B1 cor- 
responding to A1(x0) and B1(y) and a minimum 
calculation result B2 corresponding to A2(x0) and 
B2(y). The inferred result of the output variable y of 
the second proposition part is the maximum value 
of the calculation result of the minimum calculation 
results B1 and B2. The maximum calculation result 
is referred to as a membership function 730. The 
membership function 730 is given by the following 
equation. 

B0(y) = max {min [A1(x0), B1(y)], min [A2(x0) f B2- 



(V)]} (1) 

In the defuzzing means (for example, well- 
known centroid method), a real output variable yO 
5 is obtained from the membership function B0(y). In 
this case, yO which satisfies the following equation 
is obtained. 

/yO B0(y)dy = / B0(y)dy/2 (2) 

10 

The membership function of the first proposition 
part may be a triangle or trapezoid. However, the 
membership function of the second proposition part 
may be a singleton so as to simplify the weight 
75 calculation. 

In this case, since 

B1(y) = y1 t B2(y) = y2 (3) 

20 Thus, the real output variable yO can be approxi- 
mated by the following equation. 

yO = {y1 * A1(x0) + y2 « A2(x0)} / {A1(x0) + 
A2(x0)} (4) 

25 

To effectively apply such a fuzzy inference to 
control machinery, inference rules with respect to 
objects to be controlled should be translated into 
membership functions. In other words, unless the 

30 membership functions A1(x) and A2(x) of the first 
proposition parts and the corresponding member- 
ship functions B1(y) and B2(y) of the second pro- 
position parts are given, a desired fuzzy inference 
may not be obtained. However, if the membership 

35 functions and inference rules are properly ar- 
ranged, the control machinery may properly op- 
erate. When the improvement of the control accu- 
racy depends on the subjective sense of the user, 
this matter is not important. 

40 However, in the field of information processing 
system, even if it seems that the fuzzy inference 
sensitively improves the final results, the effect of 
the improvement is denoted by numeric values. 
Thus, processes with low effects are dismissed. If 

45 there is a logical discrepancy in an intermediate 
result, the problem becomes apparent. 

Since information processing systems mostly 
use non-fuzzy information, when a fuzzy inference 
is employed, the information and fuzzy inference 

so should be properly linked. In other words, the fuzzy 
logic should be consistent with the binary logic. 
When a fuzzy inference which deals with ambigu- 
ous information is performed, an inference result 
including ambiguity is output. As ambiguity of in- 

55 formation decreases, ambiguity of inference result 
decreases. When ambiguity of information is zero, 
it is expected that the inference result accords with 
the result of the binary logic. Thus, inference rules 
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should be determined without subjective sense of 
the user so as to prevent logical discrepancy unlike 
with the related art references. 

A study for arranging a fuzzy inference with a 
classical forward (positive) inference (modus 
ponens) or a classical backward (negative) infer- 
ence (modus tollens) has been proposed (Karvel K. 
Thornber, "A New Look at Fuzzy-Logic Inference", 
FUZZ-IEEE '92 Proceeding, pp 271-278, 1992). 

According to the study, a truth value uA of a 
proposition (A) constructing knowledge information 
is given by the possiblity of which (A) is true rather 
than by a membership function. An inference rule 
of if-then type (where if (A) is true, (B) is true) is 
given by the following implicating logical equation. 

[A =>B] = A'vB (5) 

To match the fuzzy logic with the classical logic, 
assume that an implicating truth value uR is given 
by the following equation. In the equation, assume 
that uA and uR are values between 0 and 1. 

UR = u[A' v B] = max [UA\ uB] (6) 

where uA' = 1 - uA 

These equations are not new. A new approach 
is in that the inference from uA to uB (forward 
inference) and the inference from uB to uA (back- 
ward inference) by the inference rules are defined 
as follows. 

If uR > uA', then uB = uR . (7) 
If uR < uA\ then uA' = uR (8) 

In this case, if uR is 1.0 and uA is 1.0 or 0.0, 
uB completely matches the inference result of the 
classical logic. If uA is 0, uB is 1. Thus, this 
expression is suitable for an expansion to hierarchi- 
cal inference. 

In such an expression, the conventional fuzzy 
inference (forward inference) is given by the follow- 
ing equation. 

uB = min [uA, uR] (9) 

Thus, the conventional fuzzy inference does not 
match the inference result of the classical logic. 
When uA is 0, uB is not 1. Thus, it is convenient 
for interpolating calculations. However, important 
characteristics of the classical logic are not trans- 
ferred to the fuzzy logic. Thus, ambiguity will take 
place when it is expanded to hierarchical inference. 

In the related art references, various inference 
methods have been proposed on the condition that 
uR is given. Even if inference rules are intuitively 
allowed, unless the truth value U.R is given, infer- 



ence cannot be performed. However, an advance- 
ment where uR can be described with a member- 
ship function in language expression should be 
appreciated. For example, with respect to learning 

5 of membership functions, efforts of improvements 
have been made in the related art references Japa- 
nese Patent Laid-Open Publication Nos. Hei 03- 
12983, 03-058201, 03-002931, 02-260002, 02- 
244203, and 02-089102. However, techniques 

w which more rationally determine uR have not been 
disclosed, thereby delaying development and eval- 
uation of fuzzy inference systems. 

As described above, in the conventional fuzzy 
inference techniques, the consistency of forward 

15 inference and backward inference in classical logic 
is sacrificed. In a fuzzy inference which has such a 
consistency, the truth values of inference rules are 
difficult to determine. As a result, fuzzy inference 
has not been successively incorporated in informa- 

20 tion processing systems dealing with knowledge 
information which contains ambiguity. 

An object of the present invention is to solve 
the above-described three problems and to provide 
a fuzzy inference system for learning inference 

25 rules necessary for fuzzy inference so as to per- 
form a fuzzy inference. 

Summary of the Invention: 

30 A first aspect of the preseni invention is a 

fuzzy inference system for learning inference rules, 
comprising an extracting means for extracting a 
first proposition part (A) and a second proposition 
part (B) of each of the inference rules from a real 

35 working system, a proposition truth value storing 
means for storing a truth value uA of the first 
proposition part (A) and a truth value uB of the 
second proposition part (B) so as to learn the truth 
values uA and u,B, a rule truth value learning 

40 means for learning a rule truth value uR from a 
plurality of sets of the truth values uA and ixB in a 
learning period, a rule validity degree learning 
means for learning a rule validity degree fr, a rule 
truth value storing means for storing the rule truth 

45 value uR, a rule validity degree storing means for 
storing the rule validity degree fr, a calculating 
means for calculating an inference validity degree fi 
with the rule truth value uR against one of the first 
proposition part (A) and the second proposition part 

50 (B) after the learning period, an inference result 
storing means for outputting the rule truth value uR 
as the other truth value of the first proposition part 
(A) and the second proposition part (B) when fi is 
equal to or higher than a predetermined threshold 

55 value, and a resultant validity degree storing means 
for outputting either the rule validity degree fr or 
the inference validity degree fi, whichever smaller, 
as an inference result validity degree. 
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A second aspect of the present invention is the 
fuzzy inference system of the first aspect wherein 
the rule truth value learning means comprises a 
bounded difference calculating means for calculat- 
ing a bounded difference between the truth value 
UB and the complement of the truth value uA with 
an output of the proposition truth value storing 
means, a bounded difference quantizing means for 
selecting the truth value uB as a truth value uRf of 
a forward inference rule when the absolute value of 
the bounded difference is equal to or larger than 
the threshold value and the truth value uB is larger 
than the complement of the truth value jllA and for 
selecting the complement of the truth value uA as 
a truth value uRb of a backward inference rule 
when the absolute value of the bounded difference 
is equal to or larger than the threshold value and 
the truth value uB is smaller than the complement 
of the truth value uA, and a forward/backward rule 
truth value selecting means for determining a first 
composition corresponding to a first learning mode 
of the truth value U.B or the complement of the 
truth value uA and the rule truth value uR, and 
wherein the rule validity degree learning means 
comprises a forward/backward rule validity degree 
selecting means for determining a second com- 
position corresponding to a second learning mode 
of the bounded difference and the content of the 
rule validity degree storing means. 

A third aspect of the present invention is the 
fuzzy inference system of the second aspect 
wherein the rule truth value selecting means is 
adapted to add the product of the rule validity 
degree fr and the rule truth value uR to the product 
of the bounded difference and the truth value uB 
and to divide the resultant value by the sum of the 
bounded difference and the rule validity degree fr, 
wherein the rule validity degree selecting means is 
adapted to add the product of the rule validity 
degree fr and the rule truth value uR to the product 
of the bounded difference and the truth value uB 
and to divide the resultant value by the sum of the 
truth value uB and the rule truth value uR. 

A fourth aspect of the present invention is the 
fuzzy inference system of the second aspect 
wherein the rule truth value selecting means is 
adapted to calculate a maximum value uRo, a 
minimum value u.Rp, and an average value uRa 
with the truth value uB or the complement of the 
truth value uA, whichever larger, read from the 
proposition truth value storing means in the learn- 
ing period and the rule truth value uR stored in the 
rule truth value storing means and to select one of 
the maximum value uRo, the minimum value u-Rp, 
and the average value uRa, and wherein the rule 
validity degree selecting means is adapted to se- 
lect the minimum value of the bounded difference 
and the rule validity degree fr. 



A fifth aspect of the present invention is a 
fuzzy inference system for learning inference rules, 
comprising a proposition collating means for out- 
putting truth values corresponding to first proposi- 

5 tion parts A1, A2, and Am and second proposi- 
tion parts B1, B2, ... , and Bm of a plurality of 
inference rules corresponding to a plurality of 
classes, a proposition truth table storing means for 
storing the truth values corresponding to respective 

10 classes, a plurality of fuzzy inference units includ- 
ing a rule truth value learning means for learning a 
rule truth value uRj for each class, a rule validity 
degree learning means for learning a rule validity 
degree frj, a rule truth value storing means for 

15 storing the rule truth value uRj, a rule validity 
degree storing means for storing the rule validity 
degree frj, an inference result storing means for 
outputting the rule truth value u.Rj as the other truth 
value inferred from a truth value nX of a first 

20 proposition part (A) or a second proposition part (B) 
after a learning period, and a result validity degree 
storing means for outputting a rule validity degree 
fr or an inference validity degree fij, whichever 
smaller, calculated with the truth value uX and the 

25 rule truth value uRj as an inference result validity 
degree, a maximum value detecting means for 
detecting a class j which has the maximum value 
of the inference validity degrees fij which are out- 
put from the inference units, and a truth value 

30 selecting means for selecting and outputting the 
content of the inference result storing means of a 
fuzzy inference unit corresponding to the class j. 

A sixth aspect of the present invention is the 
fuzzy inference system of the fifth aspect wherein 

35 the proposition collating means comprises a vector 
comparing means for storing vector data represent- 
ing a proposition and for collating each element 
thereof, a weight coefficient memory for outputting 
a weight coefficient corresponding to an element 

40 match signal received from the vector comparing 
means, a sum storing means for calculating and 
storing the sum of weight coefficients, a cumulative 
value storing means for cumulating and storing 
weight coefficients which are output from the 

45 weight coefficient memory corresponding to ele- 
ment match signals which are output from the 
vector comparing means corresponding to proposi- 
tions being input, and a division means for calculat- 
ing the ratio of the cumulative value and the sum 

50 and for outputting the result as a proposition truth 
value, and wherein the weight coefficients are up- 
dated so that the rule validity degree is improved 
during the learning period. 

A seventh aspect of the present invention is 

55 the fuzzy inference system of the first aspect 
wherein the extracting means comprises a real data 
storing means for storing real data obtained from a 
real working system, a first storing means for stor- 
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ing the first proposition part (A), a second storing 
means for storing the second proposition part (B), a 
first match degree calculating means for calculating 
a (B) match degree of real data (B) and the second 
proposition part (B), a second match degree cal- 
culating means for calculating an (A) match degree 
of real data (A) and the first proposition part (A), a 
maximum value detecting means for detecting the 
maximum value of the (B) match degree, a switch 
for sending the real data (B) to the second storing 
means when the maximum value is detected, a 
validity degree calculating means for calculating a 
rule validity degree with the (A) match degree and 
the (B) match degree, a detecting means for de- 
tecting a probability of which the rule validity de- 
gree is equal to or higher than a predetermined 
threshold value, and a data switch for outputting 
the contents of the first storing, means and the 
second storing means to the outside of the system 
when the probability is equal to or higher than the 
threshold value, and wherein the content of the first 
storing means is updated when the probability is 
equal to or lower than the threshold value. 

An eighth aspect of the present invention is a 
fuzzy inference method for learning inference rules, 
comprising the steps of classifying each of the 
inference rules into a plurality of hierarchical 
classes, storing the inference rules in an inference 
unit array having a plurality of inference units dis- 
posed in a tree shape, selecting an inference unit 
array of a lower hierarchy corresponding to infer- 
ence results of the inference units of upper hierar- 
chy, collating input propositions from the selected 
inference units by proposition collating means of 
each inference unit, and selecting inference units of 
a lower hierarchy corresponding to the collated 
results. 

A ninth aspect of the present invention is a 
fuzzy inference system for learning inference rules, 
comprising an inference unit array having a plural- 
ity of inference units, each of which has proposition 
collating means corresponding to the inference 
rules corresponding to the classes, a hierarchical 
inference rule data storing means for storing hierar- 
chical inference rule data so as to set a truth value, 
a validity degree, and a proposition of each of the 
hierarchical inference rule to the inference unit ar- 
ray, and a chain inference assisting means for 
setting inference rule data of a lower hierarchy or a 
higher hierarchy selected by a class inferred in 
each hierarchical layer to the inference unit array, 
wherein each of the inference unit is adapted to 
learn an inference rule and a proposition and to 
store the results in the hierarchical inference rule 
data storing means. 



Detailed Description: 

The fuzzy inference system of the present in- 
vention provides the following five major features. 
5 1. The fuzzy inference system of the present 
invention learns a truth value uR and its validity 
degree fr of each of a plurality of inference rules 
with truth values uA of first proposition parts and 
truth values uB of second proposition parts of 
10 the inference rules. 

2. The fuzzy inference system of the present 
invention outputs a forward inference, where uB 
is inferred from uA, and a validity degree there- 
of with the truth value uR and its validity degree 

is fr which have been learnt for each of the infer- 
ence rules. In addition, the fuzzy inference sys- 
tem outputs a backward inference, where uA is 
inferred from uB, and its validity value. 

3. The fuzzy inference system of the present 
20 invention has an inference unit array which col- 
lates propositions against inference rules cor- 
responding to respective classes and learns 
truth values uRj and uR'j and validity degrees 
frj and frj of inference rules with a plurality of 

25 sets of aAj, uBj, uA\ and uB'j as the collated 
results. 

4. The fuzzy inference system of the present 
invention has a plurality of inference units, each 
of which stores a plurality of inference rules 

30 corresponding to respective classes, so as to 
collate an input proposition with first proposition 
parts of the inference rules, inference a truth 
value, calculate an inference validity degree, and 
output an inference result with a maximum value 

35 of the inference validity degree. 

5. The fuzzy inference system of the present 
invention extracts a proposition corresponding to 
a first proposition part and a second proposition 
part of each of inference rules corresponding to 

40 respective classes, from a real working system, 
updates a proposition so as to enhance a valid- 
ity degree of each of truth values of the infer- 
ence rules, and corrects a weight for collating 
the propositions. 
45 Thus, according to the present invention, infer- 

ence rules can be extracted from knowledge in- 
formation which contains ambiguity. With the ex- 
tracted truth values and their validity degrees 
thereof, a fuzzy inference can be performed. When 
so the truth value uR is 1 or 0 and the validity degree 
fr is 1.0, the fuzzy inference matches an inference 
rule of classical logic. Thus, as ambiguity of fuzzy 
inference approaches to zero, the fuzzy inference 
result consistently approaches to an inference re- 
55 suit of classical logic. Both the fuzzy inference and 
the classical logical inference can be consistently 
incorporated in information processing which deals 
with knowledge information. 
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The preo-nl invention will be more clearly un- 
derstood from the following detailed description 
with reference to the accompanying drawings. 

Brief Description of the Drawings: 

FIGURE 1 is a Block diagram showing a fuzzy 
inference system for learning a fuzzy inference 
rule and for executing a fuzzy inference with the 
result thereof according to a first embodiment of 
the present invention; 

FIGURE 2 is a block diagram showing a boun- 
ded difference calculating means of FIGURE 1; 
FIGURE 3 is a block diagram showing a rule 
truth value selecting means of FIGURE 1 ; 
FIGURE 4 is a block diagram showing a quan- 
tizing means of FIGURE 1; 
FIGURE 5 is a block diagram showing a rule 
truth value selecting means and a rule validity 
degree selecting means of FIGURE 1; 
FIGURE 6 is a block diagram showing a mini- 
mum value calculating circuit of FIGURE 1; 
FIGURE 7 is a block diagram showing a fuzzy 
inference system using a plurality of inference 
rules according to a second embodiment of the 
present invention; 

FIGURE 8 is a block diagram showing a propo- 
sition collating means of FIGURE 7; 
FIGURE Q is a block diagram showing a fuzzy 
inference system for extracting a first part pro- 
position of an inference rule from a real working 
system according to a third embodiment of the 
present invention; 

FIGURE 10 is a block diagram showing a fuzzy 
inference system for performing an inference in 
a plurality of hierarchical levels according to 
fourth and fifth embodiments of the present in- 
vention; 

FIGURE 1 1 is a block diagram showing a fuzzy 
inference system for performing an inference of 
a plurality of hierarchical levels according to the 
fourth embodiment of the present invention; 
FIGURE 12 is a block diagram showing a fuzzy 
inference system for performing an inference in 
a plurality of hierarchical levels according to the 
fifth embodiment of the present invention; and 
FIGURE 13 is a schematic diagram for explain- 
ing a basic operation of a conventional fuzzy 
inference. 

Description of the Prefered Embodiments: 

FIGURE 1 shows an fuzzy inference system 
according to a first embodiment of the present 
invention. 

Referring to FIGURE 1, the fuzzy inference 
system does not include a means which extracts a 
first proposition part (A) and a second proposition 



part (B) of an inference rule from a real working 
system. The fuzzy inference system comprises a 
proposition truth value storing means 100, a rule 
truth value learning means 125, a rule validity de- 

5 gree learning means 135, a rule truth value storing 
means 120, a rule validity degree storing means 
130, a bounded difference calculating means 160, 
a quantizer 165, an inference result storing means 
170, a minimum value calculating circuit 180, and a 

10 resultant validity degree storing means 190. 

The proposition truth value storing means 100 
stores a plurality of sets of truth values uA of first 
proposition parts (A) and truth values uB of second 
proposition parts (B) which are extracted from the 

15 real working system. The rule truth value learning 
means 125 learns a rule truth value uR from a 
plurality of sets of truth values uA and uB in a 
learning period. The rule validity degree learning 
means 135 learns a rule validity degree fr. The rule 

20 truth value storing means 120 stores the rule truth 
value which has been learnt. The rule validity de- 
gree storing means 130 stores the rule validity 
degree fr which has been learnt. The bounded 
difference calculating means 160 calculates an in- 

25 ference validity degree fi with the rule truth value 
uR for a truth value of one of propositions (A) and 
(B) received from an input terminal 161. The quan- 
tizer 165 determines whether or not the inference 
validity degree fi is equal to or larger than a pre- 

30 determined threshold value. The inference result 
storing means 170 outputs the rule truth value uR 
as the other truth value of the proposition (A) or (B) 
corresponding to the output of the quantizer 165. 
The minimum value calculating circuit 180 selects 

35 either the rule validity degree fr or the inference 
validity degree, whichever smaller. The resultant 
validity degree storing means 190 outputs either 
the rule validity degree fr or the inference validity 
degree which has been selected by the minimum 

40 value calculating circuit 180, whichever smaller, as 
an inference result validity degree. 

The rule truth value learning means 125 com- 
prises a bounded difference calculating means 110, 
a quantizing means 115, and a rule truth value 

45 selecting means 140. The bounded difference cal- 
culating means 110 calculates the bounded dif- 
ference between uA(t) and uB(t) which are read 
from the proposition truth value storing means 100. 
The bounded difference is given by the following 

so equation. 

f(t) = uB(t) - nA'(t) = uA(t) + jxB(t) - 1 (10) 

The quantizing means 115 determines whether or 
55 not the absolute value of the bounded difference f- 
(t) is equal to or larger than a predetermined 
threshold value and generates a "1" set signal 
when the absolute value of the bounded difference 
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f(t) is equal to or larger than the predetermined 
threshold value. The rule truth value selecting 
means 140 determines a sequence of rule truth 
values corresponding to a learning mode for use. In 
other words, the rule truth value selecting means 
140 determines a composition of uB(t) or (1-uA(t)) 
and uR(t-1). 

Corresponding to the equation (6), the bounded 
difference calculating means 110 defines a truth 
value uRf of a forward inference rule for inferring 
uB from uA and a truth value uRb of a backward 
inference rule for inferring uA from uB in the 
following inference rule 

uR(t) = u[A(t) v B(t)] = max[u.A'(t), uB(t)] (11) 
where uA'(t) = 1 - uA(t) 

as 

if uB(t) > uA'(t), then uRf(t) = uB(t) (12) 
if uB(t) < uA'(t), then uRb(t) = uA'(t) (13) 

A conditional equation which selects one of 
such inference rules to be learnt is determined by 
the sign of the equation (10). If the polarity is plus, 
then uRf(t) is obtained. If the polarity is minus, then 
uRb(t) is obtained. 

The rule truth value learning means 125 com- 
prises the quantizing means 115, the for- 
ward/backward inference rule truth value selecting 
means 140, and the forward/backward inference 
rule validity degree selecting mens 150. When the 
absolute value of a bounded difference is equal to 
or larger than a predetermined threshold value and 
uB is larger than the complement of uA, the quan- 
tizing means 115 selects uB as a truth value uRf 
of a forward inference rule. When the absolute 
value of the bounded difference is equal to or 
larger than the threshold value and uB is smaller 
than the complement of uA, the quantizing means 
115 selects the complement of uA as a truth value 
uRb of a backward inference rule. The for- 
ward/backward inference rule truth value selecting 
means 140 determines a composition of uB or the 
complement of uA and uR corresponding to a 
learning mode. The forward/backward inference 
rule validity degree selecting means 150 deter- 
mines a composition corresponding to the bounded 
difference and the learning mode which is the 
content of the rule validity degree storing means 
130. Thus, the rule truth value learning means 125 
learns forward and backward inference rules. When 
necessary, the rule truth value storing means 120 
and the rule validity degree storing means 130 may 
have circuits which respectively store forward and 
backward inference rules. However, in most cases, 
forward inference rules are learnt. For the sake of 



simplicity, the description of backward inference 
rules is omitted. Thus, it is defined that the boun- 
ded difference is a positive f(t) which is obtained 
from the equation (10). 

5 Learning algorithm is constructed of rule truth 

value learning and rule validity degree learning 
which are executed by the rule truth value select- 
ing means 140 and the rule validity degree select- 
ing means 150, respectively. A plurality of sets of 

w uA(t) and uB(t) which are read from the proposition 
truth value memory 100 are learning samples. 
These samples are used for learning truth values 
and validity degrees of forward inference rules so 
that f(t) of the equation (10) becomes positive. 

75 When f(t) is negative, backward inference rules can 
be learnt. 

The learning method of rules preferably ac- 
cords with the thinking and memorizing method of 
human beings. Such a learning algorithm can be 
20 accomplished by a probability approximation learn- 
ing mode which weights a truth value with a high 
validity degree. 

The recursive arithmetic operation of the prob- 
ability approximation learning mode is given by the 
25 following equations. 

uR(t) = {f(t)uB(t) + fr(t-1)uR(t-1)}/{f(t) + fr(t-1)- 
} (14) 

30 fr(t) = (f(t)uB(t) + fr(t-1)uR(M)}/{uB(t) + uR(t-1)- 
} 05) 

Although complicated arithmetic operations are 
required, all the variables of these equations are 
35 obtained in the system shown in FIGURE 1, Thus, 
each learning sample can be always calculated. 
After the last sample (t = m) in the learning period 
has been calculated, the following rule truth value 
and the validity degree are obtained. 

40 

UR = uR(m) (16) 
fr = fr(m) (17) 

45 To simplify the arithmetic operations and ap- 

proximately obtain the above uR and fr, optimism- 
pessimism average learning mode may be used. 
This mode imitates a learning method of optimistic 
and pessimistic rules of human beings. In the rule 

so truth value learning means 125, the rule truth value 
selecting means 140 obtains one of uB(t) and the 
complement of uA(t), whichever larger, which are 
read from the proposition truth value storing means 
100 in the learning period. In addition, the rule truth 

55 value selecting means 140 obtains the maximum 
value uRo(t), the minimum value uRp(t), and the 
average value uRa(t) of uR(t-1) stored in the rule 
truth value storing means 120. Moreover, the rule 
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truth value selecting means 140 selects the aver- 
age value uRop(t) of uRo(t) and uRp(t) or the 
average value uRa(t). The rule validity degree 
learning means 135 has the rule validity degree 
selecting means 150, which selects the minimum 
value of the bounded difference f(t) and fr(M). 

Thus, the optimism-pessimism average learn- 
ing mode is accomplished. With respect to forward 
inference rules, such average values can be ob- 
tained by the following simple arithmetic oper- 
ations. 

uRo(t) = max {uB(t), uRo(M)} (18) 
uRp(t) = min {uB(t), nRp(t-1)} (19) 
uRop(t) = {uRo(t) + uRp(t)} 12 (20) 
uRa(t) = {uB(t) + uRa(t-1)} 12 (21) 
fr(t) = min {f(t),fr(M)} (22) 

The reason the rule validity degree selecting 
means selects the minimum value of the bounded 
difference f(t) and fr(M) with min operation is in 
that the logical product of the validity degree of 
each arithmetic operation of is equivalent to the 
validity degree of all the arithmetic operations. 

As described above, the truth value learning 
mode is accomplished by the rule truth value se- 
lecting means 140, whereas the validity degree 
learning mode is accomplished by the rule validity 
degree selecting means 1 50. 

After the inference rule has been learnt, the 
rule truth value uR and the validity degree fr are 
stored in the rule truth value storing means 120 
and the rule validity degree storing means 130, 
respectively. When the input of uA or uB f from the 
terminal 161 is designated, it is determined wheth- 
er the rule is used for a forward inference or a 
backward inference. In this embodiment, only the 
forward inference is considered. Thus, the bounded 
difference calculating circuit 160 calculates the fol- 
lowing inference validity degree fi. 

fi = uRf - uA* (23) 

When the quantizer 165 detects fi > 0 • 
(threshold value), it sends a "1 " set signal to the 
inference result storing means 170 and the resul- 
tant validity degree storing means 190. Thus, uB 
= uRf which is the inference result of the proposi- 
tion (B) against the truth value uB is stored in the 
inference result storing means 170. When the value 
of fi is negative, if -fi > 0, uA' = uRb is inferred. 

On the other hand, the rule validity degree fr or 
the inference validity degree fi of the forward infer- 
ence, whichever smaller, is written to the resultant 



validity degree storing means 190. (When the value 
of inference validity degree fi is negative, either -fi 
or the rule validity degree fr of the backward infer- 
ence, whichever smaller, is written to the resultant 
5 validity degree storing means 190.) Thus, the valid- 
ity degree fo of the inference result stored in the 
resultant validity degree storing means 190 is given 
by the following equation. 

10 fo = min {fr, fi} (26) 

Figs. 2 to 7 are block diagrams of the con- 
structional elements of the fuzzy inference system 
of FIGURE 1 . 

75 FIGURE 2 is a block diagram showing the 

bounded difference calculating circuit 110 accord- 
ing to the embodiment of the present invention. In 
the bounded difference calculating circuit 110, for a 
forward inference, a three-value adder 210 adds 

20 uA, uB, and -1 received from input buffers 211, 
212, and 213 so as to calculate a bounded dif- 
ference thereof. If the calculated value of the adder 
210 is positive, an output switch 215 outputs this 
value. Otherwise, the output switch 215 outputs 

25 zero. 

FIGURE 3 is a block diagram showing the rule 
truth value selecting means 140 according to the 
embodiment of the present invention. Assume that 
uB(t) and uR(t-1) are received from input terminals 

30 221 and 222, respectively, and f(t) and fr(t) are 
received from terminals 223 and 224, respectively. 
At this point, a divider 229 outputs new and old 
compositions of a rule truth value according to a 
learning mode. In this embodiment, as the learning 

35 mode, the above-described probability approxima- 
tion learning mode given by the equations (14) and 
(15) is used. Thus, although the circuitry is com- 
plicated, when the signals of the input terminals 
221 and 223 of the rule truth value selecting means 

40 220 are exchanged each other and the signals of 
the input terminals 222 and 224 are exchanged 
each other, the rule truth value selecting means 
140 accords with the rule validity degree selecting 
means 150. 

45 The rule truth value selecting means 140 com- 

prises two multipliers 225 and 226, two adders 228 
and 227, and a divider 229. The multiplier 225 
calculated f(t)uB(t). The multiplier 226 calculates fr- 
(M)uR(t-1). The adder 228 adds the outputs of the 

so multipliers 225 and 226 so as to calculate the sum 
of product thereof. The adder 227 adds f(t) and fr(t- 
1). The divider 229 calculates the ratio of the sum 
of produce received from the adder 228 and the 
sum received from the adder 227. 

55 FIGURE 4 is a block diagram showing the 

quantizer 230 according to the embodiment of the 
present invention. The quantizer 230 is a compar- 
ing circuit which outputs the polarity of the dif- 
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ference between an absolute value f of a bounded 
difference received from an input terminal 231 and 
a threshold value 0 received from an input terminal 
232 from an output terminal 233. When the polarity 
is plus, the quantizer 230 outputs "1". When the 5 
polarity is minus, the quantizer 230 outputs "0". 

FIGURE 5 is a block diagram showing the rule 
truth value storing means 120 and the rule validity 
degree storing means 130 according to the em- 
bodiment of the present invention. In the drawing, a 10 
storing means 240 is known as a register. When a 
"1" set signal is received from a set terminal 242, 
data received from an input terminal 241 is stored 
in the storing means 240. Unless another "1" set 
signal is received, the content of the storing means 75 
240 is not changed. The content of the storing 
means 240 is always output from an output termi- 
nal 243. 

FIGURE 6 is a block diagram showing the 
minimum value calculating circuit 180 according to 20 
the embodiment of the present invention. In the 
minimum value calculating circuit 180, a comparing 
circuit (COM) 253 compares signals fr and fi re- 
ceived from respective input terminals 251 and 252 
and outputs a polarity signal to a multiplexer 254. 25 
The multiplexer 254 outputs either the input signal 
fr or fi whichever smaller to an output terminal 255. 
When the input terminals of the input signals of the 
MUX 254 are exchanged each other, the larger 
value is output from the output terminal 255. 30 

FIGURE 7 is a block diagram showing a fuzzy 
inference system using a plurality of inference 
rules according to a second embodiment of the 
present invention. The fuzzy inference system 
comprises a first proposition part collating means 35 
310, a second proposition part collating means 
320, a first proposition part truth value storing 
means 340, a second proposition part truth value 
storing means 350, a plurality of fuzzy inference 
units 330, a maximum value detecting means 360, 40 
and a truth value selecting means 370. 

The first proposition collating means 310 out- 
puts truth values of first proposition parts A1 , A2, ... 
and Am of a plurality of inference rules for respec- 
tive classes. The second proposition collating 45 
means 320 outputs truth values of second proposi- 
tion parts B1, B2, ... and Bm of a plurality of 
inference rules for respective classes. The first 
proposition part truth value storing means 340 
stores the truth values for the respective classes 50 
received from the first proposition part collating 
means 310. 

The second proposition part truth value storing 
means 350 stores the truth values for the respec- 
tive classes received from the second proposition 55 
part collating means 320. Each of the fuzzy infer- 
ence units 330 comprises a rule truth value learn- 
ing means 125 (not shown), a rule validity degree 



learning means 135 (not shown), a rule truth value 
storing means 120, a rule validity degree storing 
means 130, an inference result storing means 170, 
and a resultant validity degree storing means 190. 

The rule truth value learning means 125 learns 
rule truth values uRj for the respective classes. 
The rule validity degree learning means 135 learns 
the rule validity degree frj. The rule truth value 
storing means 120 stores uRj. The rule validity 
degree storing means 130 stores frj. The inference 
result storing means 170 outputs uRj as the other 
truth value inferred from one truth value uX of the 
proposition (A) and (B) after a learning period. The 
resultant validity degree storing means 190 outputs 
one of rule validity degree fr and inference validity 
degree fi, whichever smaller, which are calculated 
with jiX and uRj. Thus, the resultant validity de- 
gree storing means 190 outputs the validity degree 
of the inference result. The maximum detecting 
means 360 detects a class j with the maximum 
value of inference validity degrees fij received from 
the inference units 330. The truth value selecting 
means 370 selectively outputs the content of the 
inference result storing means 170 of a fuzzy infer- 
ence unit 330 corresponding to the class j with a 
maximum value. 

The features of the fuzzy inference system 
according to the second embodiment of the 
present invention are as follows: 

(1) Propositions of a plurality of inference rules 
for respective classes are collated. 

(2) A plurality of inference units each learn truth 
values uRj and uR f j and validity degrees frj and 
frj with a plurality of sets of uAj, uBj, uA'j, and 
uB'j for respective classes. 

(3) The inference units each compare the infer- 
ence validity degrees so as to determine an 
inference rule with a first proposition part which 
is closest to an input proposition. 

(4) A truth value of an inference unit with the 
maximum value of inference validity degrees is 
output as a total inference result. 

With uAj and uBj for each class, when an 
inference unit 330 learns a truth value uRj = a [Aj 
= > Bj] of an inference rule where if Aj is true, then 
Bj is true, the inference unit 330 also learns a truth 
value uR'j = U [A'j => B'j] of a negative inference 
rule where if A'j is true, then B'j is true. This is 
because a desired class can be easily identified. 
According to the classical logical inference, only 
when a truth value uRj = u [Aj => Bj] of a 
forward inference rule is used, even if Aj is not 
true, uBj = uRj may be incorrectly inferred. How- 
ever, when a truth value uR'j = u [A'j => B'j] of 
an inference rule is used, the relation of uBj * uRj 
can be easily inferred. When Aj is true, if Ak is also 
determined true in another class (namely, when 
both the truth values are very large), the classes 
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are determined with validity degrees. A validity 
degree frj corresponding to uRj = u [Aj => Bj] 
and a validity degree frj corresponding to uR'j = 
U [A'j => B'j] can be learnt. However, classes can 
be determined only with frj . This is because 
classes which are less related are not often used. 

In the conventional fuzzy inference, when one 
of a plurality of inference rules to be applied is 
determined, since inference results for respective 
classes are mixed and the average thereof is ob- 
tained (namely, defuzzing technique is used), back- 
ward inference is not easily applied. However, in 
the construction shown in FIGURE 7, if backward 
inference is given, a negative forward inference 
rule is substituted with a positive backward infer- 
ence rule by applying the following equation. 

uR'j = u [A'j => B'j] = max [uA, uB 1 ] = u [Bj 
= > Aj] (27) 

Thus, an inference of uA from uBj can be 
accomplished in the following condition. 

if uB' < uR'j, then uA = uR'j (28) 

Thus, even if a plurality of inference rules are used, 
it seems that backward inference may be per- 
formed. This is an important feature for incorporat- 
ing fuzzy inference into information processing sys- 
tems. 

FIGURE 8 is a block diagram showing the 
proposition collating means 310, 320 which con- 
struct the second embodiment of the present in- 
vention. The proposition collating means 310, 320 
comprises a vector comparing means 410, a 
weight coefficient memory 420, a sum storing 
means 440, a cumulative value storing means 430, 
and a dividing means 450. The vector comparing 
means 410 stores vector data which represents a 
proposition and collates each element thereof. The 
weight coefficient memory 420 outputs a weight 
coefficient wji corresponding to a match signal for 
each element received from the vector comparing 
means 410. The cumulative value storing means 
430 cumulates weight coefficients Wji received 
from the weight coefficient memory 420 corre- 
sponding to the match signal and stores the cu- 
mulative value. The dividing means 450 outputs the 
ratio of the cumulative value wji and the sum of wji 
as a proposition truth value. 

Assuming that an i-th element of vector data is 
denoted by xi, the vector comparing means stores 
Xi which denotes a first proposition part or a sec- 
ond proposition part of an inference rule. When xi 
is equal to Xi, the vector comparing means outputs 
a match signal yi = "1". Otherwise, the vector 
comparing means outputs yi = "0". The weight 
coefficient which is read from the coefficient mem- 



ory 420 corresponding to the match signal yi is wji. 
Thus, for each vector data, the following equation is 
calculated. 

5 Sj = E yiwji (29) 

The resultant value is stored in the cumulative 
value storing means 430. When the weight coeffi- 
cient which is read from the weight coefficient 
10 memory 420 is input to the sum storing means 440 
and Mj is obtained by the following equation, 

Mj = E wji (where i = 1, 2, ... , and m) (30) 

75 then, the similarity of a registered proposition and 
an input proposition can be obtained from the 
following equation. 

Sj / Mj = E yi • wji / E wji (where i = 1, 2, ... , m)- 
20 (31) 

When all the values of yi are "1", the similarity 
becomes 1.0. This is equivalent to a membership 
function which gives truth values of uAj and uBj. 

25 The feature of the proposition collating means 

is in that a weight coefficient can be optimized in a 
learning period of an inference rule so as to in- 
crease a rule validity degree calculated with propo- 
sition truth values uA and uB which are output 

30 from the two proposition collating means 310 and 
320 against a first proposition part and a second 
proposition part. 
[Formula 4] 

35 uAj = E yi • waji / E waji (where i = 1,2,..., m)- 
(32) 

UBj = E yi • wbji / E wbji (where i = 1,2,..., m)- 
(33) 

40 

When the proposition truth values uA and uB 
are given by the above equations, for a forward 
inference rule, the weight coefficients wji of the 
weight coefficient memories 420 of the proposition 
45 collating means 310 and 320 are optimized so that 
the following validity degree is increased. 

fj = uBj - uA'j (34) 

so For a backward inference rule, the weight co- 
efficients wji thereof are optimized so that the fol- 
lowing validity degree is increased. 

fj = uA'j - uBj (35) 

55 

This weight coefficient learning algorithm ac- 
cording to this embodiment is much simpler than 
that of the conventional fuzzy inference system 
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which incorporates a neural network in learning 
membership functions. 

FIGURE 9 is a block diagram showing a fuzzy 
inference system according to a third embodiment 
of the present invention. This fuzzy inference sys- 
tem extracts a first proposition part and a second 
proposition part of an inference rule from a real 
working system. In this system, when Aj is true, a 
first proposition part Aj and a second proposition 
part Bj of an inference rule Bj is extracted from a 
real working system 500. 

In this embodiment, the value of (A) is freely 
designated. Then, (B) corresponding to (A) is 
found. An inference rule between (A) and (B) is 
detected with the validity degree of the inference 
rule. When the validity degree is low, the value of 
(A) is changed. The same steps are repeated until 
an inference rule is found. 

To execute these steps, an A-side storing 
means 510 stores first real data (A) received from 
the real working system 500. A B-side storing 
means 520 stores second real data (B) received 
from the real working system 500. First storing 
means 515 stores a first proposition part Aj. A 
second storing means 525 stores a second propo- 
sition part Bj. An A-side match degree calculating 
means 530 calculates a match degree uAj of the 
real data (A) and the first proposition part Aj. B-side 
match degree calculating means 540 calculates a 
match degree uBj of the real data (B) and the 
second proposition part Bj. Thus, the fuzzy infer- 
ence system can determine whether or not a sec- 
ond proposition part Bj corresponding to a first 
proposition part Aj is present. 

Detecting means 550 determines whether or 
not the A-side match degree uAj is equal to or 
larger than a predetermined threshold value 01. 
Whenever uAj is equal to or larger than the thresh- 
old value 61, a switch 570 sends the real data (B) 
to the first storing means 525. Maximum value 
storing means 560 stores the maximum value of 
the B-side match degree uBj. Detecting means 565 
detects the maximum value of the B-side match 
degree u,Bj. A comparator 545 determines whether 
or not the maximum value is equal to or larger than 
a threshold value 62. When the maximum value is 
equal to or larger than the threshold value 02, a 
flip-flop (FF) 575 opens the switch 570. When uAj 
is larger, Bj which gives a maximum uBj is des- 
ignated. When uBj which is larger than a predeter- 
mined threshold value is absent, it is determined 
that no rule is present. 

When uBj is larger than the threshold value, a 
rule validity degree calculating means 580 cal- 
culates a rule validity degree fr according to the 
equation (10) with uAj and uBj. Detecting means 
582 determines whether or not the rule validity 
degree is equal to or larger than a threshold value 



63. Counting means 584 counts the number of 
events where the rule validity degree is equal to or 
larger than the threshold value 03. Detecting means 
586 determines whether or not the number of 

5 events is equal to or higher than a threshold value. 
Data switches 590 and 595 output the contents of 
the storing means of the first proposition part Aj 
and the second proposition part Bj to the outside of 
the fuzzy inference system. Thus, the fuzzy infer- 

10 ence system can determine whether or not a for- 
ward inference rule is present between Aj and Bj 
with frequency of occurrences of high rule validity 
degree. When the frequency is low, the first propo- 
sition part Aj is updated. By repeating such steps, 

75 an inference rule can be detected. Data obtained 
from the same real working system has two sides 
which are data itself and compliment thereof. Thus, 
as well as a set of (A) and (B) t sets of (A*) and (B), 
(A) and (B*), and (A*) and (B') should be considered 

20 for obtaining inference rules. 

When both (A => B) and (A => B') have high 
truth values uR1 and uR2, there is an inconsis- 
tency. In this case, the following relation is satis- 
fied. 

25 

1-uA = min (uR1, uR2) (36) 

When both uR1 and uR2 are 1.0, uA = 0 
which is an inference result of classical logic is 

30 satisfied. Such an inconsistency also takes place 
between (A* => B) and (A 1 => B'). 

FIGURES 10 to 12 are block diagrams showing 
fuzzy inference systems having hierarchical con- 
struction according to fourth and fifth embodiments 

35 of the present invention. FIGURE 10 is a block 
diagram showing a state transition of a tree con- 
struction for hierarchical inference. In this embodi- 
ment, a first hierarchical level is an animal node 
S1. A second hierarchical level includes a mammal 

40 node S2 and a bird node S3. A third hierarchical 
level includes a carnivore node S4 and a ungulate 
node S5. A fourth hierarchical level includes a tiger 
node S6 and a cheetah node S7. 

A premise where a status change to a lower 

45 level takes place is an inference rule from an upper 
hierarchical level (first proposition part) to a lower 
hierarchical level (second proposition part). This 
inference rule is for example the following knowl- 
edge. 

so Inference rule from first hierarchical level to 
second hierarchical level: 

S1 => S2 : (If the animal has a fur, then it is 
a mammal.) 

51 => S3 :(lf the animal has feathers, then it 
55 is a bird.) 

Inference rule from second hierarchical level to 
third hierarchical level: 

52 => S4 : (If the mammal has sharp tooth, 
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it is a carnivore.) 
S2 => S5 : (If the mammal has ungulae, it 

is an ungulate.) 
Inference rule from third hierarchical level to 
fourth hierarchical level: 

S4 => S6 : (If the carnivore has black 

stripes on a yellowish brown 

ground, it is a tiger.) 
S4 => S7 : (If the carnivore has black spots 

on a yellowish brown ground, it is 

a cheetah.) 

According to the equations (5) to (8), since 

UR12 = u [S1 => S2] = max [uS'1, uS2] 

thus, truth values of inference rules are learnt as 
follows. 

Truth value of inference rule of S1 => S2 is uR12 
= max [uS*1, uS2] 

Truth value of inference rule of S1 => S3 is uR13 
= max [uS'1. uS3] 

Truth value of inference rule of S2 => S4 is uR24 
= max [uS'2, u$4] 

Truth value of inference rule of S2 => S5 is uR25 
= max [uS'2, uS5] 

Truth value of inference rule of S4 => S6 is uR46 
= max [uS'4, uS6] 

Truth value of inference rule of S4 => S7 is uR47 
= max [uS'4, uS7] 

Inference in a plurality of hierarchical levels is 
performed in accordance with the theory given by 
the equations (7) and (8). 

P1: If uS'1 < uR12, then uS2 = uR12 
(37) 

P2: If uSM < uR13, then uS3 = uR13 
(38) 

P3: If uS'2 < uR24, then uS4 = uR24 
(39) 

P4: If uS'2 < uR25, then uS5 = uR25 
(40) 

P5: If uS'4 < UR46, then uS6 = UR46 
(41) 

P6: If U.S'4 < uR47 t then uS7 = UR47 
(42) 

Thus, the inference is performed on a chain 
basis. In other words, the inference result uS2 of 
the premise P1 is used for the premises P3 and 
P4. The inference result of the premise P3 is used 
for the premises P5 and P6. Either uS6 or uS7 is 
output as a forward inference result. 



FIGURE 11 is a block diagram showing a fuzzy 
inference system according to the fourth embodi- 
ment of the present invention. The drawing shows 
tree connections of inference units which perform 
5 inference in a plurality of hierarchical levels. The 
inference unit arrays 631 to 633 learn truth values 
of inference rules. An input X is collated by propo- 
sition collating means (matchers) 611 to 613. The 
collated results of the matchers 611 to 613 are 
io used as truth values of first proposition parts by the 
inference unit arrays 631 to 633. 

In the first hierarchical level, an input proposi- 
tion X (animal) is sent to a multiplexer (MUX) 621 . 
Thus, an upper inference unit array 631 is selected. 
15 The input proposition X instead of uS1 is sent to 
the inference unit array 631 through the matcher 
611 and the MUX 621. The matcher 611 collates 
the input X with propositions with respect to fur and 
feathers and outputs uX2 and U.X3. uX2 and uX3 

20 are substituted with uS1 of the premise equations 
P1 and P2 according to the equation (25) in each 
inference unit. Thus, the inference results are ob- 
tained. The inference validity degrees are com- 
pared and a class corresponding to an inference 

25 unit where the inequality conditions are most 
strongly satisfied is output. The truth values uS2 or 
uS3 become equal to uR12 or uR13. 

After the validity degrees have been compared, 
assume that in the upper inference unit 6312, uS2 

30 = uR12 is satisfied and in the lower inference unit 
6313, uS3 = 0 is satisfied. In this case, the infer- 
ence result causes the multiplexer (MUX) 622 to 
select an inference unit in the next hierarchical 
level. When the upper inference unit array 632 is 

35 selected, the input proposition X instead of uS2 is 
sent to the inference unit array 632 in the next 
hierarchical level through the MUX 622 and the 
matchers 612. The matchers 612 collate the input 
X with propositions with respect to carnivore and 

40 ungulate. Thus, the matchers 612 output uX4 and 
UX5. uX4 and uX5 are substituted with uS2 of the 
premises P3 and P4 according to the equation 
(25). Thus, an inference result in this hierarchical 
level is obtained. 

45 Inference validity degrees are compared and a 

class corresponding to an inference unit where an 
inequality condition is satisfied is output. Thus, uS4 
or uS6 becomes equal to JJ.R24 or uR25. This 
result causes the multiplexer (MUX) 623 in the next 

so hierarchical level to select an inference unit in the 
next hierarchical level. 

Assume that in the inference unit 6324 of the 
higher hierarchical level, uS4 = y.R24 is satisfied 
and in the inference unit 6325 in the lower hierar- 

55 chical level, U.S5 = 0 is satisfied. In this case, the 
input X is sent to the inference unit array 633 
through the matchers 613. The matchers 613 col- 
late the input X with propositions with respect to 
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black stripes and black spots. Thus, the matchers 
613 output uX6 and uX7. uX6 and uX7 are substi- 
tuted with uS4 of the premises P5 and P6 accord- 
ing to the equation (25). Thus, an inference result 
is obtained. iiS6 or uS7 which satisfies the in- 
equality condition becomes uR46 or uR47. When 
uS6 = uR46 is satisfied in the inference unit 6336 
of the upper hierarchical level, uS7 = 0 is satisfied 
in the hierarchical unit 6337 of the lower hierarchi- 
cal level. In the steps described above, forward 
inference is performed. 

FIGURE 12 is a block diagram showing a fuzzy 
inference system according to the fifth embodiment 
of the present invention. In this embodiment, the 
hardware of the fuzzy inference system is not 
increased as the number of hierarchical levels in- 
creases, | n the fuzzy inference system, only one 
inference un it array having one hierarchical level is 
used. This fuzzy inference system has an inference 
rule data storing means 640 and an inference 
chaining assisting address control means 645 so as 
to feed back an inference result to an input. Thus, 
the fuzzy inference system has only one inference 
unit 670 for a plurality of hierarchical classes. If 
each unit array had 16 classes and there were four 
hierarchical levels, (16 x 16 x 16 + 1) inference 
units 670 would be required. However, whenever 
an inference in each hierarchical level is com- 
pleted., if an inference result, a truth value, a valid- 
ity degree, and a proposition used in the inference 
unit array 670 are rewritten, the number of infer- 
ence unit arrays 670 can be reduced to one. 

In addition to the inference units 671 to 673, 
the multiple-class inference unit comprises proposi- 
tion collating devices (matchers) 651 to 653 and 
learning truth value memories 661 to 663. All truth 
values and validity degrees thereof of rules which 
have been learnt from first proposition parts given 
in each hierarchical level and in each class are 
sent to inference rule data storing means 640 along 
with all the first proposition parts not fixed in the 
inference units 671 to 673. Thus, rule data of all 
the hierarchical levels and all the classes are 
stored in the inference rule data storing means 
640. 

Before propositions are inferred, they have 
been input from a proposition input terminal 650 
and rule data of all the classes of a selected 
hierarchical level have been set to the inference 
unit 670. Validity degrees (fil to fim) as inference 
results of the propositions are converted into class 
code by a maximum value detector 680. With the 
class code, a multiplexer 685 selects an inference 
unit which has an inference result (truth value) with 
a maximum validity degree and outputs the infer- 
ence result from a terminal 699. 

After inference in one hierarchical level has 
been completed and the next hierarchical level has 



been determined, the address control means 645 
sets all rule data of all classes of the next hierarchi- 
cal level to the multiple-class inference unit 670. 
Thus, the multiple-class inference unit 670 ex- 
5 ecutes inference for the next proposition received 
from the input terminal 650 and outputs a truth 
value and a validity degree thereof. With the valid- 
ity degree, the maximum value detecting means 
680 outputs code. With this code, the address 
10 control means 645 reads rule data of the next 
hierarchical level. 

In such a manner, inference is cyclically per- 
formed on a chain basis. A truth value and a 
validity degree of inference as inference results of 
15 each hierarchical level are output from terminals 
689 and 699, respectively. Class code of each 
hierarchical level which is output from the terminal 
679 is an attribute of an inference result. For exam- 
ple, if an animal has a fur, sharp tooth, black spots, 
20 class code representing a cheetah is output from 
the terminal 679. The validity degree of the infer- 
ence is output from the terminal 699. 

If negative inference rules such that ("if the 
animal does not have a fur, it is not a mammal." 
25 and "if the animal does not have sharp tooth, it is 
not a carnivore.") have been learnt, with the theory 
of modus tollens, backward inference can be ex- 
ecuted by the multiple-class inference unit 670 in 
each hierarchical level. When the truth value with 
30 respect to the cheetah is high, diagnosticai infer- 
ence representing that it is an animal can be ac- 
complished. 

With the following modus tollens 
S'1 => S'2 : (If the animal does not have a 
35 fur, it is not a mammal.) 

S'1 => S'3 : (If the animal does not have 

feathers, it is not a bird.) 
S'2 => S*4 : (If the mammal does not have 
sharp tooth, it is not a carni- 
40 vore.) 

S*2 => S'5 : (If the mammal does not have 

ungulae, it is not an ungulate.) 
S'4 => S'6 : (If the carnivore does not have 
black stripes on a yellowish 
45 brown ground, it is not a tiger.) 

S'4 = > S'7 : (If the carnivore does not have 
black spots on a yellowish 
brown ground, it is not a chee- 
tah.) 

50 and the following equation 

H[S'4 : => S'7] = max [uS'7, uS4], 

if S7 is true, then it is inferred that S4 is true. 
55 Likewise, with the result, if S4 is true, it is 
inferred that S2 is true. 

With the result, if S2 is true, it is inferred that 
S1 is true. 
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As described above, according to the present 
invention, the following effects can be obtained. 

1 . Unlike with the related art reference, a fuzzy 
inference which consistently satisfies classical 
logic of conventional information processing sys- 5 
tern can be performed. 

2. Unlike with the related art reference, inference 
rules and truth values can be easily optimized 
without the need to take a long time of several 
months. 10 

3. In the related art reference which employs an 
inference method suitable for interpolating oper- 
ations necessary for optimizing control amount 
of control systems, a method for representing 
inference results and inference rules has not 75 
been considered. Thus, the learning of optimiz- 
ing rules (namely, the learning of improving the 
effectiveness) is difficult However, according to 

the present invention, this problem is solved. 

4. In the related art reference, when one of a 20 
plurality of inference rules is selected, since a 
composition of inference results of each class is 
defuzzed, inference in a plurality of hierarchical 
levels is not incorporated in neither forward in- 
ference nor backward inference. However, ac- 25 
cording to the present invention, this problems 

is solved. 

5. In the related art reference, with inference 
rules, control steps involving intuitive judgement 
made by operators and designers are translated 30 
into membership functions through a particular 
language so as to automate them. However, 
since a method for introducing inference rules 
from systems where inference rules with respect 

to intuitive judgement are unknown is not avail- 35 
able, the conventional fuzzy inference systems 
have not been widely used. However, according 
to the present invention, this problem is solved. 
Thus, according to the present invention, in 
various information processing systems, inference 40 
rules can be extracted from knowledge information 
which contains ambiguity. With the extracted truth 
values and validity degrees, fuzzy inference can be 
executed. As the ambiguity of fuzzy inference ap- 
proaches to zero, the fuzzy inference result ap- 45 
proaches to inference result based on classical 
logic. Thus, the fuzzy inference can consistently 
accord with the classical logic. Consequently, the 
present invention can be incorporated in applica- 
tions which satisfy both fuzzy inference and clas- 50 
sical logic in information processing dealing with 
knowledge information. 

Claims 

65 

1. A fuzzy inference system for learning inference 
rules, comprising: 

proposition truth value storing means (100) 



for storing a truth value uA of a first proposi- 
tion part (A) and a truth value uB of a second 
proposition part (B) so as to learn said truth 
values uA and uB, said first proposition part 
(A) and said second proposition part (B) being 
extracted from a real working system by ex- 
tracting means; 

rule truth value learning means (125) for 
learning a rule truth value uR from a plurality 
of sets of said truth values uA and uB in a 
learning period; 

rule validity degree learning means (135) 
for learning a rule validity degree fr; 

rule truth value storing means (120) for 
storing said rule truth value uR; 

rule validity degree storing means (130) for 
storing said rule validity degree fr; 

means (165) for calculating an inference 
validity degree fi with said rule truth value uR 
against one of said first proposition part (A) 
and said second proposition part (B) after said 
learning period; 

means (170) for sotring the inference resul 
and for outputting said rule truth value uR as 
the other truth value of said first proposition 
part (A) and said second proposition part (B) 
when fi is equal to or higher than a predeter- 
mined threshold value; and 

means (190) for storing the resultant valid- 
ity degree and for outputting either said rule 
validity degree fr or said inference validity de- 
gree fi, whichever smaller, as an inference 
result validity degree. 

2. The fuzzy inference system according to claim 
1, wherein said rule truth value learning means 
comprises: 

bounded difference calculating means 
(160) for calculating a bounded difference be- 
tween said truth value uB and the complement 
of said truth value uA with an output of said 
proposition truth value storing means (100); 

bounded difference quantizing means 
(165) for selecting said truth value uB as a 
truth value uRf of a forward inference rule 
when the absolute value of said bounded dif- 
ference is equal to or larger than said thresh- 
old value and said truth value uB is larger than 
the complement of said truth value uA and for 
selecting the complement of said truth value 
UA as a truth value uRb of a backward infer- 
ence rule when the absolute value of said 
bounded difference is equal to or larger than 
the threshold value and said truth value uB is 
smaller than the complement of said truth val- 
ue liA; and 

forward/backward rule truth value selecting 
means (180) for determining a first composi- 
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tion corresponding to a first learning mode of 
said truth value uB or the complement of said 
truth value jxA and said rule truth value uR, 
and 

wherein said rule validity degree learning 5 
means (135) comprises forward/backward rule 
validity degree selecting means (150) for de- 
termining a second composition corresponding 
to a second learning mode of said bounded 
difference and the content of said rule validity 10 
degree storing means (130). 

3. The fuzzy inference system according to claim 
2, wherein said rule truth value selecting 
means (180) is adapted to add the product of is 
said rule validity degree fr and said rule truth 
value uR to the product of said bounded dif- 
ference and said truth value uB and to divide 

the resultant value by the sum of said bounded 
difference and said rule validity degree fr, and 20 
wherein said rule validity degree selecting 
means (150) is adapted to add the product of 
said rule validity degree fr and said rule truth 
value aR to the product of said bounded dif- 
ference and said truth value uB and to divide 25 
the resultant value by the sum of said truth 
value uB and said rule truth value uR. 

4. The fuzzy inference system according to claim 

2, wherein said rule truth value selecting 30 
means (180) is adapted to calculate a maxi- 
mum value uRo, a minimum value uRp, and 
an average value uRa with said truth value uB 
or the complement of said truth value uA, 
whichever larger, read from said proposition 35 
truth value storing means in said learning pe- 
riod and said rule truth value uR stored in said 
rule truth value storing means (120) and to 
select one of said maximum value uRo, said 
minimum value uRp, and said average value 40 
uRa, and wherein said rule validity degree 
selecting means (150) is adapted to select the 
minimum value of said bounded difference and 
said rule validity degree fr. 

45 

5. A fuzzy inference system for (earning inference 
rules, comprising: 

proposition collating means (310) for out- 
putting truth values corresponding to first pro- 
position parts A1, A2, .... and Am and second 50 
proposition parts B1, B2, ... , and Bm of a 
plurality of inference rules corresponding to a 
plurality of classes; 

proposition truth table storing means (340, 
350) for storing said truth values corresponding 55 
to respective classes; 

a plurality of fuzzy inference units (330) 
including rule truth value learning means for 



learning a rule truth value uRj for each class, 
rule validity degree learning means (135) for 
learning a rule validity degree frj, rule truth 
value storing means for storing said rule truth 
value uRj, rule validity degree storing means 
(130) for storing said rule validity degree frj, 
inference result storing means (170) for output- 
ting said rule truth value uRj as the other truth 
value inferred from a truth value uX of a first 
proposition part (A) or a second proposition 
part (B) after a learning period, and result 
validity degree storing means (190) for output- 
ting a rule validity degree fr or an inference 
validity degree fij, whichever smaller, calcu- 
lated with said truth value uX and said rule 
truth value uRj as an inference result validity 
degree; 

maximum value detecting means (360) for 
detecting a class j which has the maximum 
value of said inference validity degrees fij 
which are output from said inference units; and 

truth value selecting means (370) for se- 
lecting and outputting the content of said infer- 
ence result storing means of a fuzzy inference 
unit corresponding to said class j. 

6. The fuzzy inference system according to claim 
5, wherein said proposition collating means 
(310) comprises: 

vector comparing means (410) for storing 
vector data representing a proposition and for 
collating each element thereof; 

weight coefficient memory (420) for out- 
putting a weight coefficient corresponding to 
an element match signal received from said 
vector comparing means; 

sum storing means (430) for calculating 
and storing the sum of weight coefficients; 

cumulative value storing means (440) for 
cumulating and storing weight coefficients 
which are output from said weight coefficient 
memory corresponding to element match sig- 
nals which are output from said vector compar- 
ing means corresponding to propositions being 
input; and 

division means (450) for calculating the 
ratio of said cumulative value and said sum 
and for outputting the result as a proposition 
truth value, 

whereiby said weight coefficients are up- 
dated so that said rule validity degree is im- 
proved during said learning period. 

7. The fuzzy inference system according to claim 
.1, wherein said extracting means comprises: 

real data storing means for storing real 
data obtained from a real working system (500) 
comprising first storing means (510) for storing 
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said first proposition part (A)and second stor- 
ing means (520) for storing said second propo- 
sition part (B); 

first match degree calculating means (530) 
for calculating a (B) match degree of real data 5 
(B) and said second proposition part (B); 

second match degree calculating means 
(540) for calculating an (A) match degree of 
real data (A) and said first proposition part (A); 

maximum value detecting means (550) for 10 
detecting the maximum value of said (B) 
match degree; 

a switch (570) for sending said real data 
(B) to said second storing means when said 
maximum value is detected; 15 

validity degree calculating means (580) for 
calculating a rule validity degree with said (A) 
match degree and said (B) match degree; 

means (582, 584) for detecting a probabil- 
ity of which said rule validity degree is equal to 20 
or higher than a predetermined threshold val- 
ue; and 

a data switch (590, 595) for outputting the 
contents of said first storing means and said 
second storing means to the outside of said 25 
system when said probability is equal to or 
higher than said threshold value, and 

wherein the content of said first storing 
means (510) is updated when said probability 
is equal to or lower than said threshold value. 30 

8. A fuzzy inference method for learning infer- 
ence rules, comprising the steps of: 

classifying each of said inference rules 
into a plurality of hierarchical classes; 35 

storing said inference rules in an inference 
unit array having a plurality of inference units 
disposed in a tree shape; 

selecting an inference unit array of a lower 
hierarchy corresponding to inference results of 40 
said inference units of upper hierarchy; 

collating input propositions from the se- 
lected inference units by proposition collating 
means of each inference unit; and 

selecting inference units of a lower hierar- 45 
chy corresponding to the collated results. 

9. A fuzzy inference system for learning inference 
rules, comprising: 

an inference unit array (631) having a plu- so 
raiity of inference units (6312, 6313, ...), each 
of which has proposition collating means cor- 
responding to said inference rules correspond- 
ing to respective classes; 

hierarchical inference rule data storing 55 
means (640) for storing hierarchical inference 
rule data so as to set a truth value, a validity 
degree, and a proposition of each of said hier- 



archical inference rule to said inference unit 
array; and 

chain inference assisting means (645) for 
setting inference rule data of a lower hierarchy 
or a higher hierarchy selected by a class in- 
ferred in each hierarchical layer to said infer- 
ence unit array, 

wherein each of said inference unit is 
adapted to learn an inference rule and a propo- 
sition and to store the results in said hierarchi- 
cal inference rule data storing means. 
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